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The  Congressionally  Directed  Medical  Research  Programs  (CDMRP)  is  a  collection  of  18  individual 
programs  that  seek  to  find  and  fund  the  best  research  to  eradicate  diseases  and  support  the  warfighter 
for  the  benefit  of  the  American  public.  In  fulfilling  its  mission,  CDMRP  emphasizes  innovative,  high- 
risk,  high-gain  research  that  might  otherwise  not  be  funded  and  projects  that  forge  new  collaborations 
in  furtherance  of  important  research  objectives.  Research  proposals  (applications)  are  reviewed  using 
a  two-tiered  process  that  includes  peer  review  panels  that  evaluate  scientific  merit,  innovation,  and 
impact,  followed  by  an  external  review  that  makes  funding  recommendations  based  on  programmatic 
intent  and  portfolio  balance.  At  both  levels  of  review,  CDMRP’ s  processes  are  distinguished  by  the 
inclusion  of  consumer  advocates,  who  are  integral  to  the  program’s  ability  to  focus  on  research  that 
will  have  an  impact  on  the  communities  affected  by  the  relevant  illness,  injury,  or  disorder.  Scientific 
peer  review  is  executed  using  a  dynamic  and  flexible  process  and  produces  a  robust  and  comprehen¬ 
sive  summary  statement  that  serves  as  the  basis  for  the  second  tier  of  review,  informs  subsequent 
award  negotiations,  and  provides  valuable  feedback  to  all  applicants.  In  combination  with  a  strong 
commitment  to  integrity  and  transparency,  CDMRP’s  peer  review  processes  support  the  organization’s 
mission  to  fund  innovative,  high-impact  research. 
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INTRODUCTION 

The  Congressionally  Directed  Medical  Research 
Programs  (CDMRP),  a  research  directorate  within 
the  U.S.  Army  Medical  Research  and  Materiel 
Command  (USAMRMC),  was  established  in  1993 
to  manage  congressional  appropriations  in  support 
of  disease-targeted  extramural  biomedical  research. 
CDMRP  is  funded  through  the  Department  of  De¬ 
fense  (DoD)  by  annual  Congressional  legislation 
known  as  the  Defense  Appropriations  Act. 

CDMRP  is  a  collection  of  18  individual  pro¬ 
grams  that  benefit  the  American  public  by  seeking 
to  find  and  fund  the  best  research  to  eradicate  dis¬ 
eases  and  support  the  warfighter.  In  fulfilling  its 
mission,  CDMRP  emphasizes  innovative,  high- 
risk/high-gain  research  that  might  otherwise  not  be 
funded,  and  projects  that  forge  new  collaborations 
in  furtherance  of  important  research  objectives. 


These  programs  address  a  diverse  array  of  topics, 
ranging  from  cancer  (e.g.,  breast  cancer,  prostate 
cancer)  to  neurodegenerative  disease  (e.g.,  amyo¬ 
trophic  lateral  sclerosis)  to  deployment-related 
medical  conditions  (e.g.,  psychological  health  and 
traumatic  brain  injury).  Figure  1  depicts  the  growth 
and  evolution  of  CDMRP  since  its  inception,  and 
shows  the  increasing  diversity  of  the  research  man¬ 
aged  by  its  programs. 

Since  its  inception,  CDMRP  has  maintained  a 
central  focus  on  innovation.  This  commitment  to 
innovation  is  expressed  both  in  its  efforts  to  iden¬ 
tify  and  fund  transformative  research  and  in  the 
processes  employed  to  evaluate  proposals  (applica¬ 
tions)  submitted  for  review.  As  a  result,  the  scien¬ 
tific  peer  review  process  employed  by  CDMRP  has 
several  features  that  distinguish  it  from  other  grant¬ 
making  entities. 
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Figure  1.  CDMRP  funding  history.  To  date  the  CDMRP  has  managed  94  separate  research  programs  spanning  cancer  research, 
military-relevant  research,  and  other  disease-specific  research.  All  of  these  programs  are  aimed  at  improving  the  health  of  all 
Americans.  Since  1992,  68,175  proposals  have  been  received  and  9,675  have  been  funded. 


UNIQUE  ATTRIBUTES 

To  facilitate  the  execution  of  its  mission  and  to 
ensure  that  funding  decisions  are  made  with  a  high 
degree  of  integrity  and  transparency,  CDMRP  has 
adopted  a  number  of  processes  that,  in  combina¬ 
tion,  give  rise  to  a  unique  approach  to  conducting 
application  review. 

TWO-TIER  REVIEW 

To  evaluate  competitive  research  proposals  and 
to  ensure  both  scientific  excellence  and  program¬ 
matic  relevance,  CDMRP  adopted  the  recommen¬ 
dations  of  the  National  Academy  of  Sciences  Insti¬ 
tute  of  Medicine  (IOM)  1993  report  Strategies  for 
Managing  the  Breast  Cancer  Research  Program: 
A  Report  to  the  U.S.  Army  Medical  Research  and 
Development  Command  (1).  This  report  recom¬ 
mended  a  two-tiered  peer  review  system  that  could 
be  tailored  to  accommodate  the  goals  of  each  par¬ 
ticular  program.  CDMRP  has  adhered  to  this  ap¬ 
proach  to  evaluate  competitive  proposals.  For  a 
proposal  to  be  funded,  it  must  be  favorably  re¬ 
viewed  by  both  tiers  of  the  review  system. 

During  the  first  tier  of  this  review,  scientific  peer- 
review,  each  proposal  is  assessed  by  discipline- 
specific  panels  for  scientific  merit  and  impact  based 


on  the  criteria  set  forth  in  the  program  announce¬ 
ments.  These  evaluations  are  captured  through 
scores  and  written  critiques,  which  are  compiled 
into  a  summary  statement.  The  second  tier  of  re¬ 
view,  programmatic  review,  uses  a  comparison- 
based  process.  Proposals  are  evaluated  for  their  rel¬ 
evance  to  programmatic  goals,  alignment  with 
identified  research  gaps,  and  contribution  to  portfo¬ 
lio  balance.  This  level  of  review  is  conducted  by 
each  program’s  integration  panel  and  uses  the  eval¬ 
uations  and  scores  provided  by  the  scientific  peer 
review  panels  to  develop  a  list  of  funding  recom¬ 
mendations,  which  are  presented  to  the  command¬ 
ing  general  of  USAMRMC  for  final  approval  (see 
Fig.  2  for  an  outline  of  the  CDMRP  funding  pro¬ 
cess).  Notably,  the  consideration  of  programmatic 
intent  and  portfolio  balances  means  that  proposals 
are  not  funded  using  an  established  “pay  line” 
based  on  the  scores  assigned  during  the  scientific 
review  process. 

CONSUMER  ADVOCATE  INVOLVEMENT 

During  the  early  1990s,  advocacy  groups  mobi¬ 
lized  to  lobby  for  research  funding  that  would  spe¬ 
cifically  address  breast  cancer,  ultimately  leading 
to  the  formation  of  the  CDMRP  Breast  Cancer  Re¬ 
search  Program  (BCRP)  in  1993.  Per  the  recom- 
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mendation  of  the  1993  IOM  report,  these  advocacy 
groups  were  given  representation  on  the  BCRP  In¬ 
tegration  Panel  and  helped  to  set  the  strategic  vi¬ 
sion  for  this  new  program.  Since  the  initiation  of 
the  BCRP,  consumer  advocates  have  been  inte¬ 
grally  involved  in  all  CDMRP  programs,  serving 
both  on  the  integration  panel  and  (since  1995)  on 
scientific  peer  review  panels.  Thus,  consumer  re¬ 
viewers  arc  involved  at  every  stage  of  the  funding 
cycle,  and  CDMRP  was  the  first  Federal  funding 
agency  to  include  laypersons  on  all  peer  review 
panels. 

Consumer  reviewers  arc  members  of  the  com¬ 
munity  affected  by  the  illness  or  injury  such  as  pa¬ 
tients,  survivors,  caregivers,  advocates,  and  family 
members.  They  play  a  major  role  in  maintaining 
the  focus  of  each  program  on  disease -relevant  re¬ 
search  that  has  the  potential  to  have  a  significant 
impact  on  the  community  affected.  They  represent 
the  concerns  and  interests  of  their  respective  com¬ 
munities  in  the  review  process,  provide  a  unique 
perspective  on  disease-related  issues  important  to 
that  community,  and  contribute  a  sense  of  urgency 
to  the  peer  review  process.  Each  consumer  re¬ 
viewer  is  nominated  by  an  advocacy  or  support  or¬ 
ganization  and  is  provided  training  on  the  peer  re¬ 
view  process. 

Although  consumer  reviewers  arc  full  voting 
members  of  scientific  peer  review  panels,  they  arc 


not  expected  to  evaluate  the  proposed  research 
strategy.  Instead,  these  reviewers  focus  on  the  im¬ 
pact  of  the  proposed  project  and  frequently  provide 
input  on  other  review  criteria  to  the  extent  they  arc 
comfortable  doing  so.  Through  their  interactions 
with  scientific  reviewers  serving  on  these  same 
panels,  these  consumers  provide  valuable  insight 
about  the  research  being  evaluated  and  its  potential 
to  result  in  a  positive  outcome  for  those  affected 
by  the  disease,  injury,  or  condition  being  addressed 
by  that  specific  program. 

ANNUAL  PROGRAMMATIC 
GOAL  SETTING 

The  funding  and  goals  of  the  individual  research 
programs  managed  by  CDMRP  arc  dependent  on 
annual  appropriations  and  targeted  guidance  made 
by  Congress.  Therefore,  while  some  programs  have 
received  continuous  funding  for  several  years, 
there  is  no  assurance  from  year  to  year  that  any 
individual  research  program  will  be  able  to  solicit 
additional  grant  applications.  As  a  result,  each  pro¬ 
gram  is  managed  on  an  annual  cycle  and,  once  an 
award  is  made,  funds  arc  fully  obligated  for  the 
duration  of  the  period  of  performance. 

Because  of  the  variability  of  the  congressional 
appropriations  and  restrictions  on  how  and  when 
funds  may  be  spent,  the  CDMRP  employs  a  flexi- 
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Figure  2.  CDMRP  funding  cycle.  Each  program  cycle  begins  with  the  Congressional  appropriation.  Each  year 
the  Integration  panels  develop  a  vision  and  funding  mechanisms.  Consumers  are  critical  participants  in  Vision 
Setting,  Peer  Review,  and  Programmatic  Review.  All  awards  must  be  made  within  2  years  of  the  initial  appropri¬ 
ation. 
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ble  management  cycle  to  maintain  the  individuality 
of  each  program  while  also  meeting  the  needs  of 
Congress,  the  DoD,  the  research  and  advocacy 
communities,  and  the  public  at  large. 

At  the  beginning  of  each  program  year,  each  in¬ 
tegration  panel  will  conduct  a  “Vision  Setting” 
meeting,  during  which  programmatic  goals  arc 
evaluated  and  refined  based  on  guidance  received 
from  Congress,  recent  advances  in  research  and 
clinical  treatment,  and  the  position  of  the  existing 
portfolio  of  funded  research.  Programmatic  priori¬ 
ties  are  established  to  address  identified  gaps  in 
knowledge,  underfunded  approaches  for  preven¬ 
tion,  diagnosis,  and  treatment,  and  specific  re¬ 
source  needs  in  that  particular  field.  These  priori¬ 
ties  are,  in  turn,  translated  into  an  investment 
strategy  in  which  available  resources  are  allocated 
to  specific  focus  areas  and  award  mechanisms 
(which  arc  selected,  created,  and/or  refined  to  meet 
programmatic  needs). 

FOCUS  ON  INNOVATION 

Consistent  with  its  central  philosophy  of  sup¬ 
porting  innovation,  CDMRP  strives  to  stimulate 
new  scientific  knowledge  by  funding  high-risk, 
high-gain  research  that  would  be  less  likely  to  be 
funded  by  other  agencies.  While  an  operative  defi¬ 
nition  of  innovation  is  difficult  to  articulate,  many 
of  the  CDMRP  programs  emphasize  the  solicita¬ 
tion  of  transformative,  paradigm-shifting  research 
that  represents  more  than  an  incremental  advance 
in  existing  knowledge.  In  some  award  mechanisms, 
innovation  is  the  most  heavily  weighted  review  cri¬ 
terion  and  given  more  consideration  than  research 
strategy.  In  addition  to  using  innovation  as  a  re¬ 
view  criterion,  CDMRP  funds  a  number  of  smaller 
awards  that  permits  the  exploration  of  new,  un¬ 
tested  hypotheses;  supports  the  creation  of  new  col¬ 
laborations  and  partnerships  (which  transcend  insti¬ 
tutional  boundaries  and  subject  matter  areas);  and 
seeks  to  develop  future  innovators  and  leaders  in 
the  field.  One  example  of  this  focus  on  finding  and 
funding  untested  ideas  is  the  Concept  award  that 
was  first  offered  in  1999.  These  one-page  applica¬ 
tions  are  reviewed  by  the  two  levels  of  peer  and 
programmatic  review  without  any  identifiers  for 
the  applicant  or  their  institution.  Preliminary  data 


are  not  allowed  in  these  one-page  proposals.  Since 
1999,  over  900  Concept  awards  have  been  selected 
for  funding.  The  intended  period  of  performance  of 
these  awards  is  1  year.  An  outcome  study  was  done 
on  the  Concept  award  mechanism  in  2004,  finding 
that  approximately  72%  of  the  projects  met  some 
or  all  of  their  goals,  while  only  15%  reported  that 
the  goals  of  the  project  were  not  met.  Almost  two 
thirds  of  Concept  awardees  used  findings  from 
their  BCRP  concept  awards  in  subsequent  research 
applications. 

PEER  REVIEW  PROCESS 

The  unique  characteristics  of  CDMRP  compel  a 
dynamic  and  flexible  approach  to  conducting  sci¬ 
entific  peer  review.  The  programs  within  CDMRP 
share  many  common  features,  but  each  program  is 
unique  and  largely  autonomous.  Although  there  arc 
a  number  of  award  mechanisms  that  have  been  of¬ 
fered  consistently,  these  are  subject  to  change  to 
meet  the  programmatic  goals  established  by  the  in¬ 
tegration  panel  during  its  vision  setting  process. 
Thus,  the  peer  review  process  must  be  able  to  adapt 
to  the  introduction  of  new  programs,  changes  to 
award  mechanisms,  and  evolving  review  criteria, 
as  well  as  to  the  high  degree  of  interprogram  vari¬ 
ability. 

The  peer  review  process  is  tailored  to  meet  the 
needs  of  each  of  these  programs,  while  structured 
to  maintain  a  high  degree  of  consistency  across 
programs  and  adherence  to  best  practices  to  ensure 
the  impartial  assessment  of  scientific  merit  for  all 
proposals  submitted  for  consideration. 

PEER  REVIEW  PANELS 

Because  of  the  annual  funding  appropriation  to 
which  CDMRP  is  subject,  there  arc  no  standing 
panels  or  study  sections.  Instead,  all  peer  review 
panels  are  assembled  on  an  ad  hoc  basis,  with  the 
assigned  scientific  review  officer  responsible  for 
recruiting  a  chairperson  and  a  full  panel  of  scien¬ 
tific  reviewers  (consumer  reviewers  arc  assigned 
by  a  consumer  reviewer  administrator).  These  pan¬ 
els  are  configured  by  program  and  review  propos¬ 
als  that  have  been  segregated  by  award  mechanism 
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and  subject  matter  area  based  on  a  dynamic  map¬ 
ping  that  varies  by  program  and  award  mechanism. 
While  applicants  are  asked  to  indicate  primary  and 
secondary  research  classification  codes  upon  sub¬ 
mission,  they  may  not  request  assignment  to  a  par¬ 
ticular  panel  or  suggest  specific  reviewers.  These 
research  classification  codes  arc  used  to  automati¬ 
cally  assign  proposals  to  peer  review  panels,  with 
further  adjustments  made  to  ensure  appropriate 
placement,  to  balance  workload  between  panels, 
and  to  resolve  potential  conflicts  of  interest.  The 
applicants  do  not  know  the  composition  or  mem¬ 
bership  of  the  panel  that  their  proposal  is  assigned 
to.  At  the  end  of  each  year’s  peer  review  cycle  the 
names  of  the  peer  reviewers  arc  released,  but  their 
panel  assignment  is  not. 

Because  the  review  criteria  for  the  various  award 
mechanisms  can  be  very  different,  a  peer  review 
panel  generally  reviews  a  single  mechanism  or  a 
group  of  similar  mechanisms  (e.g.,  training  award 
mechanisms).  In  so  doing,  panel  members  are  able 
to  retain  their  focus  on  the  appropriate  review  crite¬ 
ria  and  the  programmatic  intent  of  a  particular 
mechanism.  In  addition,  this  structure  permits  the 
design  of  special  emphasis  panels,  which  address 
such  disparate  topics  as  training  awards,  clinical 
trials,  and  health  disparity  research.  The  scientific 
areas  covered  in  many  such  panels  arc  broad;  how¬ 
ever,  it  is  not  uncommon  that  the  number  of  pro¬ 
posals  submitted  for  a  single  award  mechanism  is 
large  enough  to  warrant  multiple  panels,  each  with 
a  focused  scientific  area(s)  and  a  comparable  num¬ 
ber  of  proposals. 

PEER  REVIEWERS 

Since  its  inception,  CDMRP  has  relied  on  more 
than  6,800  scientists  and  clinicians,  as  well  as  more 
than  1,000  consumers,  for  service  as  peer  review 
panel  participants.  To  achieve  the  highest  quality 
of  peer  review,  CDMRP  solicits  the  participation 
of  a  diverse  range  of  reviewers.  The  intention  is  to 
assemble  peer  review  panels  of  individuals  with  a 
complementary  blend  of  expertise,  maturity,  diver¬ 
sity,  and  viewpoints  and  to  provide  realistic  work¬ 
loads  for  the  panel  members.  In  general,  25%  of 
panel  members  arc  first-time  CDMRP  reviewers, 
and  limitations  are  imposed  on  reviewers  returning 


for  multiple  year's;  this  reinforces  the  dynamic  na¬ 
ture  of  the  peer  review  panels. 

Reviewers  are  selected  based  on  their  technical 
knowledge  and  disease-relevant  experience  as  dem¬ 
onstrated  by  their  funding  history,  professional  ex¬ 
perience,  and  publication  record.  In  addition  to 
members  with  expertise  in  the  specific  research 
topic,  panels  may  have  specialist  reviewers  such  as 
biostatisticians,  bioethicists,  clinical  trial  managers, 
intellectual  property  experts,  or  academic  deans,  as 
appropriate  to  the  particular  award  mechanism  be¬ 
ing  reviewed.  Specialist  reviewers  address  specific 
aspects  of  the  research  and  are  often  engaged  for 
more  complex  award  mechanisms  such  as  clinical 
trials,  research  consortia,  and  therapeutic  develop¬ 
ment  awards. 

PEER  REVIEW  PANEL  MEETINGS 

For  most  award  mechanisms,  peer  review  is  con¬ 
ducted  in  multipanel  on-site  meetings.  Depending 
on  program  size,  all  or  most  panels  for  a  program 
may  be  reviewed  at  a  single  meeting,  sometimes 
consisting  of  multiple  consecutive  sessions.  This 
structure  permits  program  staff  the  opportunity  to 
orient  all  panel  participants  to  the  unique  character 
of  each  program,  helping  to  ensure  a  focus  on  the 
goals  of  the  program  and  the  intent  of  individual 
award  mechanisms.  Specific  orientation  sessions 
are  generally  held  for  scientific  review  officers  and 
chairpersons,  consumer  reviewers,  and  new  scien¬ 
tific  reviewers.  In  addition,  program  history,  goals, 
and  unique  features  are  highlighted  during  a  ple¬ 
nary  presentation  immediately  preceding  the  start 
of  panel  deliberations. 

Developing  Web-based  and  paperless  review 
procedures  (e.g.,  online  proposal  access  and  cri¬ 
tique  submission)  allowed  CDMRP  to  institute  on¬ 
line  reviews  for  certain  mechanisms  with  compara¬ 
tively  small  awards  and  abbreviated  proposal 
formats,  yielding  the  efficient  and  rapid  evaluation 
of  large  numbers  of  proposals.  Unlike  on-site  meet¬ 
ings,  in  which  the  full  panel  will  discuss  the  merits 
of  a  proposal,  for  online  reviews  only  those  panel 
members  assigned  to  the  proposal  will  provide 
scores;  however,  in  cases  where  the  assigned  re¬ 
viewers  provide  disparate  scores,  an  asynchronous 
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online  discussion  is  initiated,  moderated  by  the 
chairperson  assigned  to  the  panel.  Subsequent  to 
this  discussion,  the  assigned  reviewers  have  the  op¬ 
portunity  to  revise  their  scores  and  critiques. 

PROPOSAL  SCORING  AND  EVALUATION 

Proposals  are  assigned  for  review  by  two  or 
more  scientist  reviewers  and  a  consumer  reviewer, 
each  of  whom  provides  a  written  evaluation  and 
preliminary  scores  based  on  the  published  review 
criteria.  Scores  are  provided  for  each  criterion  us¬ 
ing  a  10  to  1  scale  (with  10  being  “outstanding” 
and  1  being  “deficient”)  (Table  1).  The  criteria 
scores  form  the  basis  for  a  global  score  using  a  1 .0 
to  5.0  scale  (with  1.0  being  “outstanding”  and  5.0 
being  “deficient”).  Although  no  weighting  is  given 
for  the  individual  review  criteria,  they  are  pre¬ 
sented  in  order  of  decreasing  importance.  Review¬ 
ers  are  instructed  to  base  their  global  score  on  the 
criteria  scores,  although  unscored  criteria  (e.g., 
budget,  proposal  presentation,  and  others  depend¬ 
ing  on  the  award  mechanism)  may  be  taken  into 
consideration.  Notably  the  scales  used  for  the  crite¬ 
ria  and  global  scores  arc  inversely  (but  nonli nearly) 
related;  although  there  should  be  correspondence 
between  the  criteria  scores  and  the  global  score, 
these  scales  arc  intended  to  discourage  the  calcula¬ 
tion  of  a  global  score.  All  panel  members  score  the 
proposal  at  the  end  of  panel  deliberations. 

PREPROPOSAL  REVIEW 

An  increasing  volume  of  proposals,  and  the  cor¬ 
responding  decrease  in  the  percentage  that  were  ul- 


Table  1.  CDMRP  Scoring  Scale 


Adjectival 

Global 

Criteria 

Outstanding 

1.0- 1.5 

10-9 

Excellent 

1.6-2. 0 

8-7 

Good 

2. 1-2.5 

6-5 

Fair 

2.6-3. 5 

4-3 

Deficient 

3.6-5. 0 

1-1 

All  grants  receive  Criteria  scores  for  the  individual  review  cri¬ 
teria  (Innovation,  Research  Strategy,  etc.)  as  well  as  an  overall 
Global  score.  There  is  not  a  formula  used  to  convert  the  Crite¬ 
ria  score  to  a  Global  score.  The  two  types  of  scores  are  related, 
but  not  derived  from  each  other. 


timately  funded,  suggested  the  need  for  a  screening 
process  to  reduce  the  number  of  proposals  brought 
forward  for  peer  review.  Therefore,  for  some  award 
mechanisms,  CDMRP  requires  the  submission  of  a 
brief  preproposal,  which  provides  essential  infor¬ 
mation  about  the  intended  proposal.  After  consider¬ 
ation  of  responsiveness  to  programmatic  intent,  ap¬ 
parent  scientific  merit,  innovation,  and/or  impact,  a 
subset  of  preproposal  submitters  are  then  invited  to 
submit  a  full  proposal.  As  a  result,  CDMRP  is  able 
to  reduce  costs  by  subjecting  fewer  proposals  to  a 
full  peer  review  process  and  to  reduce  the  burden 
on  applicants  who  might  otherwise  spend  time  pre¬ 
paring  a  full  proposal  that  would  be  unlikely  to  be 
funded. 


EXPEDITED  REVIEW 

Another  method  used  to  increase  the  efficiency 
of  the  peer  review  process  is  expedited  review, 
which  is  a  form  of  triage  used  to  reduce  the  number 
of  proposals  discussed  during  the  peer  review  panel 
meeting.  Expedited  review  recommendations  are 
determined  by  program  staff  based  on  the  prelimi¬ 
nary  (premeeting)  scores  provided  by  the  assigned 
reviewers.  Reviewers  may  not  nominate  a  proposal 
for  expedited  review,  but  have  the  ability  to 
“champion”  any  proposal,  which  will  result  in  its 
being  returned  to  the  list  of  proposals  to  be  dis¬ 
cussed  at  the  meeting. 

The  scores  used  to  derive  the  expedited  review 
list  may  include  one  or  more  criteria  scores  and / 
or  the  global  score,  as  appropriate  to  the  program 
and  award  mechanism.  Thus,  these  decisions  may 
be  made  on  the  basis  of  a  proposal’s  scores  on 
innovation  or  impact  rather  than  research  strategy. 
Because  funding  decisions  are  not  based  solely  on 
the  final  global  score,  a  retrospective  analysis  of 
historical  data  is  used  to  set  the  thresholds  for  ex¬ 
pedited  review  (generally,  between  10%  and  25%) 
to  minimize  the  probability  that  a  potentially 
fundable  proposal  will  be  excluded  from  the  dis¬ 
cussion.  Proposals  subject  to  expedited  review  are 
not  discussed  during  the  peer  review  panel  meet¬ 
ing  and  are  not  scored  by  the  full  panel;  however, 
the  principal  investigator  receives  a  summary 
statement. 


FOSTERING  INNOVATION  THROUGH  PEER  REVIEW 
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SUMMARY  STATEMENTS 

The  output  of  the  CDMRP  peer  review  process 
is  a  robust  and  comprehensive  summary  statement 
that  serves  as  the  basis  for  the  second  tier  of  re¬ 
view,  informs  subsequent  award  negotiations,  and 
provides  valuable  feedback  to  all  applicants.  A 
summary  statement  is  prepared  for  every  full  pro¬ 
posal  received  and  includes  a  summary  of  the  pan¬ 
el’s  findings,  global  and  criteria  scores,  the  cri¬ 
tiques  provided  by  each  reviewer  (scientist,  consumer, 
and  specialist),  and  budget  recommendations. 

INTEGRITY  AND  TRANSPARENCY 

CDMRP  is  committed  to  maintaining  the  trans¬ 
parency  of  its  review  process.  A  number  of  proce¬ 
dures  are  used  to  ensure  the  integrity  of  the  review 
process. 

COMPLIANCE  REVIEW 

A  rigorous  administrative  compliance  review  is 
conducted  for  each  proposal  submitted  to  CDMRP 
to  ensure  that  the  specifications  set  forth  in  the  pro¬ 
gram  announcement  have  been  followed  and  that 
no  applicant  has  obtained  a  competitive  advantage 
by  virtue  of  a  breach  of  these  guidelines. 

GOVERNMENT  LIAISON 

A  government  liaison  (GL)  is  assigned  to  ob¬ 
serve  the  deliberations  of  each  peer  review  panel 
and  is  responsible  for  monitoring  compliance  with 
established  processes  and  the  conduct  of  an  impar¬ 
tial  and  objective  review  of  proposals.  The  GL  is 
additionally  responsible  for  ensuring  that  no  panel 
member  with  a  potential  conflict  of  interest  is  pres¬ 
ent  during  deliberations. 

CONFLICT  OF  INTEREST 

Preventing  conflicts  of  interest  is  critical  for 
maintaining  the  integrity  of  the  peer  review  pro¬ 
cess.  Numerous  procedures  and  detailed  guidelines 
are  established  to  identify  and  prevent  potential 
conflicts,  including  both  automatic  and  manual 
techniques. 


CONFIDENTIALITY 

Review  procedures  require  that  panel  members 
treat  all  proposal  materials,  panel  discussions,  and 
review  outcomes  as  confidential.  Contact  between 
applicants  and  a  peer  review  panel  member  is  pro¬ 
hibited,  and  the  membership  of  individual  peer  re¬ 
view  panels  is  not  disclosed  (although  a  list  of  all 
reviewers  is  published  annually  for  each  program). 

INQUIRY  REVIEW  PROCESS 

The  Inquiry  Review  Panel  (IRP)  was  established 
by  CDMRP  to  address  questions  and  appeals  by 
applicants  regarding  either  the  scientific  peer  re¬ 
view  or  programmatic  review  of  their  proposals. 
The  IRP  determines  whether  factual  or  procedural 
errors  have  occurred  and  may  recommend  that  a 
proposal  be  sent  for  rereview  by  either  the  scien¬ 
tific  peer  review  or  integration  panels. 

SUMMARY 

In  combination  with  a  strong  commitment  to  in¬ 
tegrity  and  transparency,  CDMRP’ s  peer  review 
processes  support  the  organization’s  mission  to 
fund  innovative,  high-impact  research.  CDMRP  is 
a  dynamic  organization  that  must  regularly  adapt 
to  changes  in  the  amount  and  composition  of  its 
annual  congressional  appropriations,  evolving  pro¬ 
grammatic  visions,  and  a  rapidly  advancing  scien¬ 
tific  environment. 

Unique  attributes  of  CDMRP,  such  as  consumer 
reviewer  involvement  and  the  use  of  a  two-tier  re¬ 
view  process,  ensure  that  the  organization  remains 
tightly  focused  on  its  mission.  Despite  the  chal¬ 
lenges  posed  by  the  fluid  circumstances  in  which  it 
operates,  CDMRP  is  able  to  effectively  and  effi¬ 
ciently  execute  its  mission  through  a  commitment 
to  rigorous  process  and  its  culture  of  continuous 
process  improvement. 
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